Multi-objective test case prioritization in highly configurable systems: A case study
نویسندگان
چکیده
Test case prioritization schedules test cases for execution in an order that attempts to accelerate the detection of faults. The order of test cases is determined by prioritization objectives such as covering code or critical components as rapidly as possible. The importance of this technique has been recognized in the context of Highly-Configurable Systems (HCSs), where the potentially huge number of configurations makes testing extremely challenging. However, current approaches for test case prioritization in HCSs suffer from two main limitations. First, the prioritization is usually driven by a single objective which neglects the potential benefits of combining multiple criteria to guide the detection of faults. Second, instead of using industry-strength case studies, evaluations are conducted using synthetic data, which provides no information about the effectiveness of different prioritization objectives. In this paper, we address both limitations by studying 63 combinations of up to three prioritization objectives in accelerating the detection of faults in the Drupal framework. Results show that non–functional properties such as the number of changes in the features are more effective than functional metrics extracted from the configuration model. Results also suggest that multi-objective prioritization typically results in faster fault detection than mono-objective prioritization.
منابع مشابه
Multi Objective Algorithms for Automated Generation of Combinatorial Test Cases with the Classification Tree Method
Test case selection and prioritization are well studied and understood regression testing techniques. Equally, test case generation is an active research area. Yet the combination of these techniques remains largely unexplored. This paper proposes to use a multi objective approach to combine a test case generation technique, the Classification Tree Method, with a test case selection and priorit...
متن کاملIdentification and Prioritization of Factors Affecting Sustainable Energy Management with Multi-criteria Decision Making Approach (Case Study: Farabi Hospital in Bastak, Hormozgan Province)
متن کامل
A Multi-objective Model for Location of Transfer Stations: Case Study in Waste Management System of Tehran
This paper presents a multi-objective optimization model for the design of a waste management system consisting of customers, transfer stations, landfills and collection vehicles. The developed model aims to simultaneously minimize the total costs, greenhouse gas emissions and the rates of energy consumption. To tackle the multiple objectives in the problem, we utilize an interactive fuzzy prog...
متن کاملInternational Journal of Intellectual Advancements and Research in Engineering Computations Priority based test case generation for Multi object
While performing regression testing, an appropriate choice for test case ordering allows the tester to early discover faults in source code. To this end, test case prioritization techniques can be used. Several existing test case prioritization techniques leave out the execution cost of test cases and exploit a single objective function (e.g., code or requirements coverage). In this paper, we p...
متن کاملDynamic Test
Test case prioritization technology is to sort the test cases before the software testing designed to improve test efficiency. This paper presents a dynamic test case prioritization technique based on multi-objective. It integrates several traditional single-objective technologies so that makes it more flexible. This technology, from five dimensions, calculates prioritization values of test cas...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Journal of Systems and Software
دوره 122 شماره
صفحات -
تاریخ انتشار 2016